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ABSTRACT 

Computer assisted instruction (CAI) in Biology and 
Developmental Reading was administered at two junior high schools and 
two senior high schools in Philadelphia. The achievement of the 
students in CAI was compared with comparable students in 
traditionally instructed classes. The results of the standardized 
tests were eguivocal. In Reading, the CAI classes performed 
significantly better than comparable students in traditional classes. 
Differences in achievement were not obtained between the CAI and 
traditional Biology classes. This was attributed to computer down 
time and a lack of sufficient content validity in the standardized 
Biology test. An attitude survey constructed for the project 
indicated that the pupils liked working with the machines, but were 
frustrated when the system did not function properly. A discussion of 
the project, including the results of unstandardized achievement 
tests, and an analysis of the pupils* responses while interacting 
with the comouter is included. Tables of statistical data /supplement 
the report. The appendix contains a list of topics covered in the CAI 
units arid samples of the student and teacher guestionnaires. 
(Author/JY) 
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Preface: 



The attached report covers the first full year of operation of Project 
GROW, the large Ooiq>uter Assisted Instruction project of the Philadelphia 
Schools. Use of developmental research as a basis for decision making in 
Project GROW marks it as an unusual effort for a public school system, and 
we are very pleased that research results have been useful in helping to 
identify a nunft>er of needed program changes, and in answering certain basic 
guestions. Answers to these questions were used in planning the GROW program 
for the coming year. 

The report is quite frauik, as a good research report must be, in dii-Tuss- 
ing both strengths and fieaknesses of the project. Overall, the results are 
quite promising auid clearly suggest great potential for CAI, as it is being 
used in project GROW. We feel that good progress was made the first yecir, 
both in the program itself and in the related research design, and we look for- 
ward to even more meaningful results at the end of 1969 - 1970 . 

William C. Theimer, jr. 

Director 

Division of Developmental Research 

Sylvia Charp 

Director of Instructional Systems 



kr£ tract : 



Computer Assisted Instruction (CAI) in Biology and Developmental Reading 
was administered at two junior high schools and two senior high schools in 
Philadelphia. 

The achievement of the students in CAI was compared with comparable students 
in traditionally instructed classes. 

The results of the standaurdized tests were equivocal. In Reading, the 
CAI classes performed significantly better than comparable students in tra~ 
ditional classes. Differences in achievement were not obtained between the 
CAI and traditional Biology classes. This was attributed to computer down* 

and a lack of sufficient content validity in the standardized Biology test. 

An attitude survey constructed for the project indicated that the pupils 
liked working with the machines but were frustrated vrtien the system did not 
function properly. 

A discussion of the project including the results of unstandardized 
achievement tests and an analysis of the pupils' responses while interacting 
with the conqputer was included. 



Introduction : 



This report presents a summary of the Project Grow activities for the 
school year 1968-1969. The report is divided into five sections. The first 
deals with a description of the system and data relating student performance 
to some variables collected as part of the computer programs eoiployed in Project 
Grow. We typically refer to these as "on-line" data. 

The second section presents the results of the standardized achievement 
tests given in June, 1969 to the students participating in the project. Test- 
ing was done for both Project Grow curricula: Biology and Reading. For the 

purposes of comparison, we have also presented data in sections two and three 
for students in traditionally instructed classes. 

Section three discusses the results of an attitude survey given to both 
students and teachers participating in the project. These data may indicate 
directions for subsequent research. 

The fourth section discusses the results of achievement tests which have 
been constructed for use in the program. We have used the term "off-line" to 
designate these data. 

Sections one through four include explanations and summaries. In addition, 
section five presents an overall summary and suggestions for the future. 

Before presenting the data from the past months' activities, a very impor- 
tant caveat needs to be included. We in Philadelphia have what is probably the 
most sophisticated Cooputer Assisted Instruction system in the country. This 
sophistication can only be achieved by manipulating a highly complex system of 
con^uter hardware, software, and peripheral equipment such as teletypes. What 
has happened this past year is that, partly because of the e 3 q>erimental nature 
of the program and partly because of the conqslexity of the system, there has 
been a great deal of so-called "down-time." That is, there have been times when 



the system has not functioned properly. Therefore, we have only partial data 
in many areas and frequently have been able to ask more questions than we have 
answered. In fact, there is almost no data from Wanamaker Junior High School 
because of a very late start in Computer Assisted Instruction and because of 
resulting "down-time . " Problem areas such as this are to be expected during 
the implementation of a new system. We must caution the reader not to dismiss 
the concept of CAI based upon the results of a few months with an experimental 
program. This would be a great disservice to the pupils and teachers involved. 

We believe that our general feeling concerning CAI can be summarized by 
quoting one of the teachers participating in Project Grow. As he said: 

"Advertise (if advertise you must) : 

a) that the program is experimental. 

b) that there are 'bugs,' and that debugging will take place in due time. 

c) that units of work are constantly revised as the need arises. 

d) that the vrork will be adapted to a changing school population as 
we find changes in attitude , approach , method , material , and 
evaluation are needed. 

e) above all, stress the CAI aspect of the program - Computer Assisted 
Instruction - that the system in no way is intended to supplant the 
teacher - that the human brain in no instance is meant to be replaced 
by an electronic brain. 

f) that teacher attitude can affect the success of the CAI program. 
Teachers need to be patient , need to believe in the progreun, need 
to grow into the program, which is an evolving one. 

g) that we are 'pioneering' and have only begun to scratch the surface. 

We look forward hopefully to mastering technic[ues and processes that 
will demonstrate the increasing value of CAI instruction." 



Finally, the reader needs to be aware of event which took place during 
February, 1969. At that time the Central Processor, which had been at the 
Philco-Ford plant in Willow Grove was moved into a building shared by the 
Pennsylvania Advancement School at 5th and Luzerne Streets, in additi: the 

sophistication of the system was increased through the incorporation of a different 
computer as the Central Processor. The results of this change in hardware and 
location have been as indicated above. Our data are preliminary. They are 

tentative. They need to be considered as only a starting point toward future 
experimentation . 



Section One 



Description of the system ; 

The CAI system in Philadelphia currently employs two curricula: 

Biology and Reading. In the future. Mathematics will be added. Four schools 
are involved in the project, two high schools and two junior high schools. 

The majority of the high school students who participate in the project are 
in .3 tenth grade while the typical junior high student is an eighth or 
ninth grader. 

In each school there are eight so-called SAVI units. SAVI stands 
for student-audio-visual interface. The interfaces are integrated system 
elements containing both visual receiving equipmv?..c and keyboard transmitting 
equipment. Through these devices, students are presented with alphanumeric 
or graphic information in visual form. The keyboard provides the facility for 
typing responses into the system. In addition, the student may use a light 
pen to simply point at appropriate information as another method of responding. 

At each school there is also a cluster processor which is made up of computing 
and control elements, a magnetic core memory, and a mass memory in which the 
curriculum progreuns are entered and stored. 

The outermost element of the system, the Central Processor, is a 
large scale computer with extensive magnetic core and mass storage facilities. 

The Central Processor is designed to handle large amounts of intricate data, 
to do statistical analyses and to solve mathematical problems. In our system, 
the curriculum is developed in the Central Processor and stored there for 
later distribution to the schools as required throughout the day. 

At both the schools and the Central Processor, there is the necessary 
peripheral equipment such as teletypes, punched card handlers, and printers, plus 
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othGr dGvicGs necGssary to th© dovelopmont , ontry, storago, and rotrioval of 
the curriculum material. 

The programming language used in the CAI system is referred to as 
the INFORM author language. Using this language, the authors have taken the 
curriculum material and translated it into a form which can be stored in the 
computer. Each topic in the cxirriculum is a collection of concepts. We can 
think of a concept as a small instructional group which gets united with other 
concepts to form a topic. Each concept includes instructional material with 
which the student interacts. The computer then monitors the results of that 
interaction, noting such information as how long a student took to respond, 
whether he was right or wrong, and so on. The students' responses are examined 
according to a set of categories. For example, a student's response will be 
classified as Correct, Incorrect, Anticipated Wrong (this means the curriculum 
writers inserted answers which were neither right nor wrong but which they 
anticipated the students would give. When finding one of these Anticipated 
Wrong answers, the computer might then branch the student into a specific 
remedial path) , Time-up (the student did not respond in the specified time, 
usually five minutes) , Unrecognized Wrong Answer (not a response which fell 
into the previous categories but it was not a recognizable one either) , or 
Inclusive (none of the above) . 

By using the data in these categories and other information, the 
computer generates reports which can indicate the learning patterns of a 
particular student or groups of students. 

Five types of reports can be generated. They are typically referred 
to as off-line reports and are outlined below. 

The off-line reports include: 

a. Trace — Detailed student activity reports produced by special request 

b. Question Summary--Author report for question validation and analysis 

c. Student Summary— -Teacher report on cumulative student progress 
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d. Topic Sunaary — ^Author report for topic analysis and validation 

e. weekly Sunmary — Teacher report on student progress prepared weekly 

f . Daily Schedule**System schedule report prepared daily for operations use 

a. Trace Report 

This report is a highly detailed reseau:ch*type report which specifies 
each curriculum question label and response recorded and evaluated by the 
system. Hie report may be used to determine exactly how a specified 
student answered every question within a specified curriculum segment 
as recorded on the Student History File. Data described in the Trace 
includes : 

(1) Heading Data**Rqport number, title and student ID number, and 
requestor's name. 

(2) Concept Labels~Conc^t nundier, major and minor label numbers 

(3) Response Time~Latency time in seconds for each question (label) 
answered by the student 

(4) Input Mode**Answer type: K for ke^x>ard or L for Lightpen 

(5) Examine Hode~Indicates whether Key Group (K) or Specific Order (O) 
options were specified for question's Examine command 

(6) Response Code»Specifies idiich answer command was accessed by the 
student (C, W, A, T, U or X) . Answer nuidiers and answer part 
numbers or each C, W, or A answer matches are printed. If an 
unrecognized (U or X) answer is given, the actual wrong typed 
response or lightpen coordinates aure printed. 

b. Question Sunsmiry Report 

This is an author report %diich indicates how a particular question 
was answered by all students to date. It provides the following data: 

(1) Vmber of students answering the question 

(2) Number of attempts (responses) to the question 

(3) Number of students correct on first atteapt 

(4) Average response (latency) time in seconds. Longest and shortest 
latency time in seconds 

(5) The number and percentage of each ans«fer type given by all students 
sampled is printed (correct, wrong, anticipated, time*up, unreco- 
nized and inclusive X path answers) 

(6) Unrecognized wrong answers are printed with frequency data for each 

(7) Long form (optional) summaries additionally provide a detailed 
answer frequency matrix chart. This option is recommended only for 
complex multi-part questions with a large variety of possible 
answers 
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c. student Sunmary Report 




This is a teacher report providing cumulative student progress data. 

A picture of each student's activity for the term is presented with 
average scores, latencies and topic times. The report consists of 
the following: 

(1) Heading data: Report title, student name and ID number, request 

name and report date 

(2) Nufldser of topics conq>leted to date 

(3) Average number of responses (per topic) 

(4) Average latency time in seconds (for each question answered) 

(5) Average topic time in hours and minutes 

(6) Average scores are given as follows: 

Nund>er and percentage Ck>rrect (C) 

" " " ffrong (W) 

" " " Anticipated (A) 

" " " Time-Up (T) 

" " " Unrecognized (U) 

" " " Inclusive (X) 

(7) Counter totals (cumulative) for all topics are also given 

c. Topic Sunmary Report 

Hiis is mainly an author report idiich is useful in determining overall 
student success in handling a particular topic or test. The report 
specifies the same type of data items as the Student Summary, Init for 
all students recorded to date rather than one specific student. 

Data includes: 

(1) Heading data — Report title, topic name, requestor's name, report 
date 

(2) Number of students conq>leting the topic 

(3) Average number of responses 

(4) Topic time in hours and minutes 

(5) Average latency time per response in seconds 

(6) Cumulative counter totals 

e. Weekly Summaury Report 

This report is prepared and distributed weekly for all teachers and is 
the most inqportant off-line prepared teacher report. The report is 
formatted with a separate detailed report for each student assigned to 
a particular teacher, sequenced by teacher ID and student ID for each 
teacher's class. 

Data includes: 

(1) Heading data — Report title, teacher name, report date (week beginning) 

(2) Student data includes: Student ID number, name and Topic name and 

statistical topic data for each topic conqpleted 

(3) Topic data includes: number of responses, topic time in hours and 

minutes, average latency time in seconds, number and percentage of 
each type of answer given (C, W, A, T, U, X) 

(4) Optional counter print-outs can also be requested (long form) but 
are not recommended. 



1-4 



1 




Three ASR Teletype reports are also generated. 

The on-line ASR reports are constantly being printed on the ASR teletype 
associated with each cluster con^niter system. These reports include the 

(a) Daily Cluster Schedule Report 

(b) Student Sign-Off Report 

(c) Student Topic Report 

a. Daily Cluster Schedule Report 

This report is identical to the off-line printed schedule report but 
with data for that particular school cluster. The report lists the 
period, scheduled student ID numbers, student names and current concept 
numbers for all students scheduled for terminal activity that day. 

b. Sign-Off Report 

This report is printed as soon as each student signs-off from the 
terminal. The report includes: 

(1) Student ID number, ncune and date 

(2) Time on and off the terminal in 2400 hour clock time. 

(3) Number of responses made 

(4) Ending concept and label number 

c. Student Topic Report 

This report is printed each time each student completes a different 
topic unit or topic test. The report includes: 

(1) Student name and report date 

(2) Name of current topic completed (or test) 

(3) Topic coB^letion time in hours and minutes 

(4) Number of responses 

(5) Number of correct answers and percentage correct 



The language and the majority of the hardware used in the project have 
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been developed and produced by the Philco-Ford Corporation. Much of this 
description can be found in the Project Grow Author Reference Manual which 
was prepared for the School District by Philco-Ford. Figure 1 shows a 
schematic of the system. 

Each CAI class consists of approximately 16 students. During each class 
period, which lasts roughly 45 minutes, the student spends half his time at 
the SAVl unit and half his time at a central table with the teacher and the 
other students not at the consoles. The teacher typically does not interact 
with the students at the SAVI console so he can devote more of his time to 
each individual pupil at the central table where appropriate materials are 
provided to supplement the console curriculum. Since each student progresses 
at his own rate, each class may have students who are at widely disparate points 
in the curriculum. This situation can be handled by the con^uter and at 
present has not been a problem for the teachers. 
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Analysis of the Relationship between Currlcultim-Related 



Variables and Unit Achievement in CAI Biology 



This section of the report describes the results of an analysis done 
to determine the relationship between a student's performance during a 
unit or topic of instruction and his final achievement on that unit. The 
variables included in this analyisis were those that were collected as 
part of the weekly summary reports generated by the Philco-Ford CAI system. 
Briefly, these summaries show the topics and topic tests completed by each 
student in any one week. Report (e) described on page 1-4 was used for 
this analysis. Also included were data on variables which were hypothesized 
to be related to test performance and would therefore be relevant in dif- 
ferentiating among the various students in the CAI classes. These curri- 
culum-related variables were: 

1. Sex of student: Sex is not a curriculum-related variable but 

was included in this analysis. 

2. Time on Unit: This is the time it took the student to complete 

the unit, in minutes. 

3. The average time it took a student to answer each question in 
the unit, in tenths of a second. 

4. The nuid>er of correct answers given in a unit. 

5. The number of wrong answers given in a unit. These are 
actual wrong answers and omitted answers. 

6. The number of answers that were not correct, wrong, or omitted. 

This would include the number of times a student failed to 
answer a question in the specified time limit or failed to ever 
give a recognizable answer, i.e., recognizable to the coaq>uter. 

7. The time to complete the unit achievement test, in minutes. 

8. The average time it took the student to answer the questions 
on the unit achievement test, in tenths of a second. 

9. The dependent variable in this analysis was the nund>er of 
correct answers to the topic achievement test. 
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The model used for data analysis was multiple linear regression. 

The dependent variable was the number right in the unit achievement test 
and the predictor variables were the first el^t variables listed on page 
1 - 9 of this report. Since these variables are collected as a matter of 
routine and since the analysis was not Intended to help decide which 
should be collected In the future, all variables were Included rather than 
doing the analysis In a stepwise fashion idiere only some would be. Our 
basic purpose was to determine whether the data now being gathered could 
be used to predict achievement. If so, this will help us to understand 
the student-currlculum-computer interaction. 

Multiple regression analyses were done for those units where suffi- 
cient subjects were available. The number of subjects for whom data were 
available varied because the pupils progressed at different rates. In 
addition, the data were collected before the system was moved. Neverthe- 
less, we were able to obtain adequate data for some of the beginning 
Biology Units. These units were: Cells, Energy and Life, Elements and 

Compounds, and Chemical Symbols. The reader can consult Appendix 1 for a 
complete list of the CAI Biology topics. The regression analysis for each 
Biology Unit Is reported below. 

For the four units, we have calculated the multiple correlation showing 
the relationship between the scores on variables 1 throu^ 8 and the 
criterion variable of unit achievement. We reported whether each of these 
correlations could be considered statistically different from zero. In 
essence we are trying to determine whether we can predict student achieve- 
ment more accurately using these el^t variables than we could by guessing 
pupil achievement by some random method. 
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The table accompanying each unit's results shows the raw score and 
standard score wel^ts. We can use these weights to judge which variables 
make the greatest contribution to the correlation. The variables whose 
wei^ts are the closest to zero make the least contribution. Each table 
also includes the average score (MEAN) and the standard deviation (SIGMA) 
for each variable. 

Cells : 

Thirty-seven subjects had complete data on Cells. The multiple 
correlation for predicting unit achievement was 0.736 which was signifi- 
cantly different from zero at the .05 level. Table 1 shows the raw score 
and standard score regression weights, and the means and standard deviations 
of the variables involved in the regression analysis. The nunibers of the 

variables correspond to those used on page 1 - 9 of this report. 

TABLE 1 



REGRESSION WEIGHTS, MEANS, AND STANDARD DEVIATIONS FOR THE 
VARIABLES USED IN THE REGRESSION ANALYSIS OF CELLS DATA 



VARIABLE 


RAW SCORE 
WEIGHT 


STANDARD SCORE 
WEIGHT 


MEAN 


SIGMA 


1 


-1.5721 


-0.2165 


1.5946* 


0.4977 


2 


0.0046 


0.0137 


41.7297 


10.8388 


3 


-0.0133 


-0.0901 


133.4324 


24.5917 


4 


0.1376 


0.1198 


51.1351 


3.1461 


5 


-0.0997 


-0.1875 


7.7027 


6.7981 


6 


-0.2133 


-0.4488 


19.2162 


7.6053 


7 


0.0282 


0.0140 


4.5946 


1.8022 


8 


0.0034 


0.0316 


104.3784 


33.1975 


9 






12.3514$ 


3.6149 


RAW SCORE 


INTERCEPT = 13. 


7763 






*MALE = 1 


; FEMALE » 2 








^The test 


on Cells had 19 


items. 
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Energy and Life ; 



Twenty-one subjects had complete data on the unit Energy and Life. 

The achievement criterion was again the nund>er right on a unit test given 
at the SAVI console after instruction. The same eight variables as listed 
page 1-9 of this report were the predictors. The multiple-correlation for 
these data was 0.582 which was not significantly different from zero at 
the .05 level. Table 2 shows the raw score and standard score regression 
weights and the means and standard deviations of the variables involved in 
the regression analysis. 



table 2 

REGRESSION WEIGHTS, MEANS, AND STANDARD DEVIATIONS FOR THE VARIABLES 
USED IN THE REGRESSION ANALYSIS OF ENERGY AND LIFE DATA 



VARIABLE 


RAW SCORE 
WEIGHT 


STANDARD SCORE 
WEIGHT 


MEAN 


SIGMA 


1 


1.9128 


0.4520 


1.5238* 


0.5518 


2 


0.0544 


0.1914 


30.0000 


7.6223 


3 


0.0217 


0.4599 


127.2381 


45.9499 


4 


0.3313 


0.2805 


43.5238 


1.8335 


5 


0.1636 


0.4443 


5.9048 


5.8814 


6 


0.1746 


0.3881 


12.9048 


4.8156 


7 


-0.1021 


-0.0434 


1.9524 


0.9207 


8 


-0.0216 


-0.3617 


94.2857 


36.2742 


9 






6.0952^ 


2.1658 



RAW SCORE INTERCEPT = 16.5565 
★male - 1; FEMALE * 2 

$The test on Energy and Life had 10 items. 
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Elements and Compounds : 

Data were available from 42 CAI students for this unit. The 
dependent and independent variables were the same as those stated above. 
The multiple correlations for these data was 0.578 which did not differ 
significantly from zero at the .05 level. Table 3 shows the raw score 
and standard score regression wei^ts and the means and standard deviations 
of the variables involved in the analysis. The numbers of the variables 
correspond to those used on page 1-9 of this report. 



TABLE 3 



REGRESSION WEIGHTS, MEANS, AND STANDARD DEVIATIONS FOR THE VARIABLES 
USED IN THE REGRESSION ANALYSIS OF ELEMENTS AND COMPOUNDS DATA 



VARIABLE 


RAW SCORE 
WEIGHT 


STANDARD SCORE 
WEIGHT 


MEAN 


SIQAA 


1 


-0.4350 


-0.0873 


1.5714* 


0.5999 


2 


0.0042 


0.0214 


49.1667 


12.6778 


3 


0.0038 


0.1045 


115.6905 


69.2061 


4 


0.0679 


0.3217 


73.9762 


11.8352 


5 


-0.0092 


-0.0479 


12.7857 


12.9380 


6 


-0.0654 


-0.2703 


19.6190 


10.3121 


7 


-0.1640 


-0.0726 


2.7381 


1.1036 


8 


-0.0083 


-0.0899 


63.9048 


27.0481 


9 






13.7619^ 


2.4969 



RAW SCORE INTERCEPT = 11.1632 
*MALE = 1; FEMALE = 2 

$The test on Elements and Compounds had 18 items. 
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Chemical Symbols : 



The final unit for which sufficient data were available was Chemical 
Symbols. Twenty-nine subjects had complete data for the criterion variable 
and the eight predictors. The obtained multiple correlation was 0.832 
which was significantly different from zero at the .05 level. Table 4 
shows the raw score and standard score regression weights and the means 
and standard deviations of the variables used in the regression analysis. 



TABLE 4 

REGRESSION WEIGHTS, MEANS, AND STANDARD DEVIATIONS FOR THE 
VARIABLES USED IN THE REGRESSION ANALYSIS OF CHEMICAL SYMBOLS DATA 



RAW SCORE 

VARIABLES WEIGHT 


STANDARD SCORE 
WEIGHT 


MEAN 


SIGMA 


1 


-0.7391 


-0.1148 


1.5172* 


0.5085 


2 


0.0515 


0.1504 


32.5517 


9.5528 


3 


-0.0118 


-0.2101 


74.6552 


58.2570 


4 


0.0688 


0.1957 


54.1724 


9.3046 


5 


0.0150 


0.1196 


17.6207 


26.1662 


6 


-0.1767 


-0.8534 


15.1034 


15.8076 


7 


-0.4242 


-0.1693 


4.2759 


1.3065 


8 


0.0179 


0.2980 


70.0345 


54.6400 


9 






13.0000^ 


3.2733 



RAW SCORE INTERCEPT = 12.5656 
*MALE = 1; FEMALE « 2 

$The test on Chemical Symbols had 18 items. 



Analysis of Reading Data : 



We had anticipated that analyses simileu: to those done with the Biology 
data could be done in Reading. However, several factors prevented this. For 
one, the topics in Reading are much longer than those in Biology. Therefore, 
it takes a great deal of time to collect sufficient data so that a meaningful 
analysis can be performed. 

As indicated elseidiere in this report, the weekly sumnary reports idiich 
generate the data for many of the Project Grow analyses had to be modified 
following the movement of the system to 5th and Luzerne Streets. 

The result of these two factors has been that we did not have enough data 
to allow us to perform reliable analyses. Rather than doing calculations on 
data from a small nundber of stud., its, we have decided to wait until next year 
when more substantial work can be done in this area, and more reliable results 
obtained. We do have data from standardized tests in Reading and from the 
teachcx and student questionnaires. These Reading data are presented in the 
appropriate sections. 
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The data clearly point to some degree of association between the 
criterion and predictor variables. The fact that scMne of the multiple 
correlations were not significantly different from zero is not disturbing. 

In reality the significance test may have little meaning for these data. 

The basic reason is that the students form %ihom con?)lete data were available 
are v er y likely not a randcm sang)le from the CAI population in Philadelphia. 

TO the extent that this is true, tests based upon errors of sampling such 
these need to be interpreted cautiously. If one would treat these results 
as descriptive of <-hese piq>ils, then some conclusions can be drawn. We 
interpret the weights given in Tables 1 through 4 by looking at their value 
without regard to sign. The variable's making the least contribution to the 
multiple correlation are those %diose %ieights are close to zero. 

The sK>st consistent result of these data is that the time variables, 
especially time on unit (Variable 2) and time on test (Variable 7) , make 
the least contribution to the multiple correlation. This is probably because 
the latency variables are highly correlated with time variables and therefore, 
with other considerations, the time variables can account for no unique variance 

A second reason might be that the mastery philosophy behind CAI would 
lead to a low correlation between unit achievement and any other variable. The 
variability of topic test scores should theoretically be low if the curriculum 
guides the pupil until he masters the material. The low variability would then 
lead to low correlations. Typically the standard deviations (SIGMA) of the 
variables esployed in this analysis do not support this hypothesis. However, 
future data might. There was no variable idiich consistently made a large 
contribution to the multiple correlation. In addition, there was no indication 
of a substantial sex difference in achievement. 
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What this means is that in order to predict student adiievement, ire 
need to include all the variables in an analysis. For example, me cannot 
consistently predict achievement by knowing only the sex of a pupil. This 
is analogous to the problem of a college admissions office. No one variable 

can predict college achievement to any great degree. However, if many 
variables are included, the accuracy of prediction is much greater. 

Our data have really served two purposes. First, they can be used 
to predict achieves^nt and secondly, they can be used to describe how the 
average student perfonss on the SAVI console. By consulting Tables 1 through 
4, the reader can see idiat the average performance was with an indication 
of variability. We might have anticipated that the mean nunber correct on 
the topic achievement tests would have been higher. These means went from 
61Z on Energy and Life to 76T on Elesients and Compounds. Future analyses 
on larger groups of subjects will allow us to determine the effectiveness 
of the resMdial loops in the project GROW curriculum. These data and others 
will then be used to interpret the present results. All of these will then 
add to our knowledge of the interaction between the student and the cosqniter. 
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Section TVo 




Note on Selecting Sfnderdlzed Achievement Teets ; 

In selecting e stenderdlzed Instrument for use in e project, one often hes 
to compromise. Stenderdlzed tests ere constructed for use over e wide renge of 
educetlonel settings with e number of different objectives in mind. An individuel 
test user typicelly hes only e few objectives in mind with e reletively smell num- 
ber of students. One cennot expect the stenderdlzed test to deel exectly with the 
objectives end content of e single clessroom curriculum. However, it is possible 
to select one which comes es close es is feesible end idiich will provide meeningful 
dete. We believe this end hes been echieved for both Biology end Reeding. 
Standardized Test Results : Gf»tes-MecGinitie Reeding Tests : 

Survey D end Survey E of the Getes-HecGinitie Reeding Tests were employed es 
flnel stenderdlzed tests to be given to the Project GROW students in Reeding. Sur- 
vey D wes used et Roosevelt Junior High School end Survey E wes used et Germentown 

Hig|i School end Overbrook Hig^ School. 

Eech Survey consists of three perts: Speed end Accurecy, Vocebulery, end 

Comprehension. The Speed end Accurecy Test conteins 36 short peregrephs eech 
followed by e question or en incosiplete stetement for which the student selects 
one of four elterretives which best enswers the question. We scored this test 
only for Accurecy end did not deel with e Speed score idiich would ordinerily be 
the number of peregrephs e student completed in four minutes. 

The 50 item Vocebulery Test requires the student to select one of five words 
whose meening is the closest to the stem word. 

For exemple: 
home 

e. rock 

b. moment 

c . telk 

d. house 

e. some 

2-1 

s=a,....aaaa»aatfMi«^ — .. 



The Itens ere arranged in order of difficulty. That is, the beginning items 
are the easiest, idiile the final items are much more difficult. 

The Comprehension Test requires the student to choose words from those given 
which will, idien placed in blank spaces in a paragraph, make the material the most 
understandable. For the 21 reading passages included in this sub test, there are 
52 blank spaces which the students must fill in. 

For example: 





Homing pigeons may be used to 


carry messages. 


Their sense 


of Cl enables them 


to 


find their way C2 


_ over unfamiliar territory. 








a 


b 


c 


d 


e 


Cl 


humor 


direction 


distinction 


valves 


confusion 




f 


g 


h 


i 


j 


C2 


blocked 


masked 


driving 


lost 


home 




For the Project GROW students. 


three scores were derived. 


The Accuracy score 



was the number correct on the Speed and Accuracy Test, while the Vocabulary and Com- 
prehension scores were the number correct on those corresponding sub tests. 

The basic objective of the Project GROW Reading curriculum was to "...improve 
the ability of students in the 8th, 9th, and 10th grades in Junior and Senior Hi^ 
Schools to better comprehend what they read..." The program and curriculum were 
designed for students of "normal" intelligence who were reading at approximately 
fifth grade level. The program was not designed to teach a student to read but ra- 
ther to take a poor reader and iioprove his comprehension skills. 

The Comprehension subtest of the Gates-MacGinitie Reading Tests comes the closest 
to the objectives of the program. The other tests were included to supplement the 
Comprehension data and to obtain information on other areas where the program might 
have had a differential effect between CAI pupils and traditionally instructed pupils. 
Since students were assigned at random to the CAI classes (given the above reading level 
requirements) , meaningful comparisons can be made between the two methods of instruction. 
In addition to emphasis in other areas, the traditional classroom curriculum was also 
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designed to Improve the comprehension skills of pupils. We therefore believe thet 
the most Importent comperlson would be for the Comprehension subtest scores 
with Accurecy end Vocebulery being of relevent but secondery Interest. 

Beceuse we were deei ing with e study idiere dete on three dependent 
verlebles were collected, the results were enelyzed using e multlverlete 
Anelysls of Verlence. In this wey, we hoped to control our Type I error 
rete. Thet is, we hoped to evoid the situetion in which one finds slgnifi- 
cent differences eisong treetment groups when in feet there ere none simply 
by virtue of doing e greet number of stetisticel tests. As with other ene* 
lyses, the results will be presented seperetely for eech school. 

Roosevelt Junior Hifdi School: 

Dete from three Reeding desses, ell teugiht by the seme teecher, were 
enelyzed using e multlverlete Anelysls of Verlence. Tvo were CAI desses 
•nH the third wes e treditionelly instructed dess. All pupils were of 
similer ebility. 

Teble 1 shows the meens end stenderd devietions of the three desses 
for the three dependent verlebles. 

Teble 1 

Mean and Standard Deviations of the Reading Classes of 
Roosevelt Junior High School on the 
Three Subtests of the Gates-MacGinitie Reading Tests 





CAIi 


CAI 2 


Treditionel 


Accurecy 


Keen 


18.21 


18.83 


14.13 


Stenderd Devietion 


5.27 


5.75 


7.30 


Vocebulery 


Keen 


35.29 


33.00 


20.75 


Stenderd Devietion 


8.04 


4.39 


7.67 


Comprehension 


Meen 


38.86 


36.50 


22.88 


Stenderd Devietion 


8.48 


7.18 


13.30 
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The multlverlete F-retio generated from these data mas 3.558 idilch was 
significant at the 0.01 level. This statistic is interpreted in the same 
manner as a univariate F-ratio. That is, the significant F-ratio indicates 
that the three means of one of the treatment groups differ significantly 
from the three means of at least one other treatment group. Inspection of 
Table 1 clearly indicates that the performance of the CAT classes was superior 
to the traditionally instructed class on all three variables. With respect to 
Vocabulary and Compr^ension, the differences were practically as well as 
statistically significant. The average CAT student scored about 60% higher 
than the average traditionally Instructed pupil in Vocabulary and Compre- 
hension. There was no difference between the groups on Accuracy. 

Germantown Hiidi School : 

At Germantown High School the multivariate F-ratio was equal- to 0.783 
which was not significant at the 0. if) level. Table 2 shows the means and 
shamm^^^i^SB* *nd standard deviations of the five Reading classes used in 
the analysis. As can be seen, there is no clear tendency for the CAT classes 
to outperform the traditionally instructed classes. This is true regardless 
of whether we look at the Accuracy score, the Vocabulary score, or the Compre- 
hension score. This is of course, what is conveyed by the non- significant 
FTatio* 

Table 2 

Means and Standard Deviations of the 
Gemantown High School Reading Classes on the 
Three Subtests of the Gates -MacGini tie Reading Tests 





CAI^ 


CAI 2 


TRAD.i 


TRAD . 2 


TRAD. 


Accuracy 

Mean 

Standard Deviation 


11.09 

4.25 


12.14 

4.62 


9.33 

5.57 


10.50 

3.33 


11.88 

5.59 


Vocabulary 

Mean 

Standard Deviation 


16.27 

4.67 


16.07 

5.34 


18.78 

5.59 


13.33 

4.55 


17.38 

5.26 


Comprehension 

Mean 

Standard Deviation 


27.46 

10.01 


25.71 

6.50 


25.44 

6.50 


22.83 

9.54 


25.38 

11.15 
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Overbrook School; 



"^he results of 4 CAI Reading classes were compared with one traditionally 
instructed class. Two different teachers were involved, one for the CAI 
classes and one for the traditional class. All the students were of average 
ability and randomly assigned to the treatments within the sampling limits 
mentioned above. 

"^e obtained multivariate F-ratio of 5.805 was significant at the 0.01 
level. Inspection of the means of the five classes shows substantially 
superior performance (statistically and practically) for the CAI students. 

The reader of course notes that these differences may be due to the differences 
in teacher ^ility rather than method of instruction. While this is true, it 
is very unlikely that teachers of similar experience, as was the case here, 
would differ in effectiveness to the degree implied by these data. It would 
appear that these results would most correctly be interpreted as relating 
to difference in instructional method with the CAI method leading to superior 
achievement. 

Table 3 shows the results for the five classes in question. 

Table 3 

Means and Standard Deviations of the 



Overbrook High School 


Reading 


Classes 


on the 




'Tiree Subtests of 


the G*»tes-Mac''initie Reading Tests 






CAI^ 


CAI 2 


CAI 3 


CAI 4 


Trad . 


Accuracy 








14.25 


5.25 


Mean 


10.83 


13.50 


11.27 


Standard Deviation 


2.79 


3.34 


3.80 


6.62 


2.66 


Vocabulary 








18.17 


5.38 


Mean 


16.17 


21.25 


19.09 


Standard Deviation 


5.23 


3.81 


4.37 


4.04 


3.74 


Comprehension 








29.92 


11.00 


Mean 


30.83 


35.75 


24.46 


Standard Deviation 


6.80 


3.85 


11.36 


11.15 


5.18 



,.er|c 
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2 



5 



SumnMirv 



Except et Gemumtown High School, stetlstlcelly slgnlf leant differences 
were obtained between the Comprehension scores of the CAI students and the 
t'^sdltlonally Instructed students. We could not attribute this difference 
to either the ability level of the students or the differences In teacher 
effectiveness. When one teacher teaches only CAI classes and another teacher 
teaches only traditionally Instructed classes, we have what Is called In ex- 
perimental design, a confounding. We do not know whether any differences in 
performance obtained among these classes are due to teacher differences or to 
method of Instruction: they are confounded. However, when teachers are of 

similar experience and training, we make the assumption that they are equally 
effective. Given the results from other schools and from other studies, it 
is much more likely that the superior performance of the CAI students was due 
to the method of instruction rather than the different teachers. The confounding 
was present at Overbrook High School but not at Roosevelt, idiere one teacher 
tau^t both the CAI and traditional classes, and the former group performed 
significantly better. 

There is no clear explanation for the results at Germantown High School. 
Toward the end of the year, this school experienced a great deal of "down- 
time" due to a malfunction in an air conditioner. It is possible that the 
differential effect of the two instructional methods was "wiped out," as It 
were, by this "down-time." Future studies and experience with CAI will help 
us to answer this question. 
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standardized Test Results : 

Nelson Biology Test For m F : 

The Revised Editioji of the Nelson Biology Test was administered to the 
Project GROW students and to the Biology students in the traditionally in- 
structed classes. The Nelson Biology Test includes items which measure the 
extent to which students have attained important educational objectives. These 
objectives could be clasr.ified according to Bloom's Taxonomy as dealing with 
Knowledge, Comprehension, and Application. 

In the Revised Edition of the Nelson Biology Test, the authors have 
attempted to include new materials which reflect the changes in biology 
instruction such as the three approaches of the Biological Science Curriculum 
Study . They have, however, retained approximately one-third of the items from 
the 1950 edition. 

Fifty-two percent of the items on the Nelson Biology Test deal with what 
the authors call Life Processes . This includes: (1) Human Health and Functions, 

(2) Plant and Animal Life, !3) Life Cycles, Reproduction, Heredity, and Biological 
History. Twenty eight percent of the items contain content related to Living 
Things including Characteristics, Cellular and Molecular Structure, Classification 
and Grouping. The remaining items deal with Ecological Relationships and 
Methodology and Research . The total test contains 65 4-choice multiple choice 
items with a fifth distractor for guessing. If a student does not know the 
answer to a guestion, he is instructed to mark the fifth option which is labelled 
"DK" for "Don't Know." The authors have found that the use of this option tends 
to cut down on wild guessing and may therefore make the scores more reliable or 

consistent. 

The data generated from the administration of the Nelson Biology Test were 
analyzed using Analysis of Variance techniques and are reported for each school 

separately. 



o 
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Roosevelt Junior High School : 



Nelson Biology data were obtained for six classes at Roosevelt Junior High 
School. Three of the classes, taught by one teacher, were in CAI; while the 

other three classes, taught by a second teacher, received traditional instruction 
in Biology. 

Table 3 shows the means and standard deviations and the results of the 
analysis of variance for the six groups tested. 

Table 4 

Analysis of Variance Data for the Nelson Biology Test 
from Roosevelt Junior High School 

CAI]^ CAI2 CAI3 Tr]^ Tr2 Tr3 
Mean 18.12 20.56 13.80 15.65 20.12 14.92 

Standard Deviation 4.74 7.91 2.34 8.12 9.23 5.32 



ANOVA Source TaJsle 



Source 


df 


SS 


MS 


F 


Between Groups 


5 


759.55 


151.91 


3.19 


Within Groups 


110 


5236.47 


47.60 





The 0.01 rejection rule for 5 and 110 degrees of freedom is almost exactly 
3.19. We went ahead, and in a sense "made believe" the null hypothesis was 
rejected. That is, post-hoc analyses were done using the Scheffe technique. Two 
comparisons were made. The first involved a comparison of the performance of 
the students in the two academic tracks present at Roosevelt. The second involved 
the con5)arison of the CAI and Traditionally instructed pupils. Neither of these 
comparisons were significant. Our general conclusion was to suspend 
judgement regarding Roosevelt Junior High School and to wait until more data can 
be collected. 

Germantown High School 

Data from three CAI classes and three traditionally instructed classes 
were analyzed using analysis of variance techniques. 

Table 5 shows the analysis of variance data for these calculations. 



A 



2-8 



MttfiilHBimili 




Table 5 



Analysis of Variance Data for the Nelson Biology Test 
from Germantown High School 



Mean 

Standard Deviation 



Source 

Between Groups 
Within Groups 



CAI^ 


CAl 2 


CAI 3 


Tradj^ 


Trad^ 


Trad 


H . 50 


10.67 


9.00 


8.89 


8.67 


9.13 


2.64 


6.41 


5.15 


6.19 


6.19 


6.31 



Anova Source Table 



of SS MS F 

5 56.90 11.38 0.38 

41 1230.93 30.02 



Inspection of the means 



and the obtained F-ratio indicates that there was 



no difference in the performance of the pupils 



in the two instructional methods. 



Overbrook High School : 

At Overbrook High School, we have the situation where each of two teachers 
teaches one class in CAT and one traditionally instructed class at each of two 
academic tracks. In the language of experimental design, we say that the factors 
Of Method Of instruction. Academic Track, and Teacher are completely crossed. This 
is a very desirable situation because it allows us to look beyond the basic 
question as to whether the students in CAl achieve higher than those in the tradi- 
tional classes. He can look at other issues. For example, if there is a difference 
between CAI and traditional classes, does this difference exist regardless of 



which academic track the students are in? Using the language of analysis of 

variance, we would be looking for an interaction between Method of Instruction and 
Academic level. 



Table 6 shows the cell means and marginal means plus the analysis of variance 
of the Nelson Biology scores at Overbrook High School. The analysis of variance 
indicated that the only significant effect obtained was for Academic Track. The 
students in the Academic level performed significantly better than those in the 
Regular Track. This is not surprising. There was no difference between 
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the performance of students taught by Teacher A versus those taught 

by Teacher B. In addition, there was no difference between CAI performance and 

those students in the traditionally instructed classes. 



Table 6 



Cell Means, Marginal Means, Analysis of Variance for 
Nelson ^’iology Test Scores at Overbrook High School 



CELL IDENTIFICATION CELL MEAN 

CAI, Acadesiic Track, Teacher A 17.00 
CAI, Academic Track, Teacher B 19.88 
CAI, Regular Track, Teacher A 8.50 
CAI, Regular Tr?ck, Teacher B 12.50 
Traditional, Academic Track, Teacher A 11.25 
Traditional, Academic Track, Teacher B 20.50 
Traditional, Regular Track, Teacher A 11.25 
Traditional, Regular Track, Teacher B 9.13 



FACTOR 


LEVEL 


MEAN 


Instructional Method 


CAI 


14.47 




Traditional 


13.03 


Academic Track 


Academic 


17.16 




Regular 


10.34 


Teacher 


A 


12.00 




B 


15.50 



ANOVA Source Table 






Source 


df 


Mean Squares 


F 


Between Instructional Methods 


1 


33.06 


<1 


Between Academic Tracl>. 


1 


742.56 


17.23 


Between Teachers 


1 


796.00 


4.54 


I.M. XA.T. 


1 


20.25 


<1 


I.M. XT. 


1 


0.06 


<1 


A.T. XT. 


1 


105.06 


2.44 


I.M. XA.T. XT. 


1 


156.25 


.3.63 


Nithin Cells 


56 


2412.75 





Summary ; 



The general result from these data was that the CAI students did not 
achieve significantly higher scores th2ui the traditionally instructed pupils. 

Roosevelt Junior High School, there was some indication of a difference, 

\ 

but it was not large enough to be meaningful statistically. At both high 

X 

schools, there was clearly no difference between the groups. 

There ar^ three possible explanations which come to mind. Because these 

data are based upon the results of st£uidardized tests, we need to remember 

that although the test selected may have been the most suitable, it may not 

have enough content validity to show the differences which actually exist. 

A second possibility ii^lves the system itself. As stated many times 

in this report, problems with^e hardware cuid software resulted in large 

amounts of "down-time" expecia]|ly at Germantown High School. One might 

« 

argue that in reality no student really attended a CAI class and, therefore, 
any comparison made is not between CAI and traditional instruction and therefore 
not relevant. 

A third es^lanation would be that there is really no difference between 
CAI cuid traditional methods. While it is possible that this js true, the 
data from this study are somewhat tentative cuid we believe that this conclusion 
is premature 2md basically incorrect. 
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Section Three 



Attitude Survey ; 

A questionnaire was constructed to obtain information on how the students 
and teachers perceived the computer system and s^e of the areas idiere they 
believed it was particularly strong or weak. Data were obtained from 4 Reading 
teachers, 5 Biology teachers, 76 Reading students, and 124 Biology students. 

The data are reported for students and teachers separately. No breakdown was 
made according to school unless the responses to a particular question differed 
markedly over different schools. Readers interested in the complete question- 
naires employed can consult the appendices to this report where copies are 

presented. Any percentages that are reported are given to the nearest whole 
percent . 

Reading Students ; 

Data were gathered from 76 Reading students. Twenty- three students were 
from Germantown High School, 22 were from Roosevelt Junior High School, and 31 
%#ere from Overbrook High School. 

Question 1: "During each period, you worked part of the time with the 

SAVI Unit and part of the time with the teachers. Do you think that there 
should be more time spent on the machines?” 

Responses to this question showed considerable variation over schools. At 
Germantown, 39% of the students in Reading answered "yes" to this question while 
at Roosevelt, 59% responded affirmatively. At Overbrook 26% said they would like 
more time on the machines %diile 52% said they %K>uld not. Generally speeJcing 
the students who indicated that they would not want more time at the machines 
said the reason was that their teachers could ans%ier questions and give infor- 
mation that the computer did not or could not give. The students in favor of 
more time on the SAVI consoles indicated that they felt they could learn more 
from the machine. The students favoring more time on the machines were quite 



specific in their desires, as were those who were negatively disposed. The issue 
is clearly not settled. The preference for more or less time on the machines 
may reflect different personality characteristics of the pupils. There is a 
possibility that we are dealing with two distinct populations: one "pro" 

machine and the other "anti" machine. This would be an interesting area for 
future research. 

Virtually 100% of the students in Reading indicated that the machines 
were easy to use and they enjoyed working with them. However, in this latter 
area, 52% of the Overbrook students either disliked or had no opinion on that 
paurt of the lesson that was at the SAVI unit. At the other schools, only an 
occasional student indicated that he disliked working with the SAVI unit. 

When asked why one liked working with the consoles most students chose 
reasons such as "I could go at my own speed" or "it took nice small steps which 
I could understand." 

When asked for reasons as to why one did not like working with the SAVI, 
these students who answered this question generally indicated that "it was 
boring." The percentage of students falling into this category ranged from 
52% at Germantown and Roosevelt to 72% at Overbrook High School. When con- 
trasted with the corresponding percentages for the Biology students, we may 
be seeing a reaction to some factor in the Reading curriculum which is inher- 
ently tedious rather than anything involved in the hardware. (As shown below, 
very few Biology students reported that working with the SAVI was boring.) 

A sizable percentage of the students (e.g. 48% at Roosevelt) indicated 
that they were unhappy with the SAVI units because they didn't %#ork properly. 
These students were pointing to "bugs" in the software packages. For exanqple, 
there are instances in iidiich the computer says that a child gave a %n:ong answer 
to a question when he did not. This is particularly frustrating to the pupils. 
The students also commented on the fact that the machines did not work reliably. 
Since this program is still experimental, problems such as this are to be 
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expected and will be dealt with. 

The Reading pupil, generally speaking, had no suggestions for improving the 
SAVI units although there was minor dissatisfaction with the light-pen and some 
students thought the use of sound or arranging the keys in alphabetical order 
would be a help. 

Summary ; 

Typically the students in Reading enjoyed %#orking with the SAVI unit. They 
were undecided as to whether more or less time should be spent with the machine. 
The self-pacing aspect of CAI was favorably received by the students although 
there vas some indication that %«orking with the machine could be boring. 
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Reading Teachers t 



Since responses were available on only four Reading teachers / the reader 
should be cautioned that the opinions reported herein may represent only one or 
two teachers. 

The Reading teachers indicated that they felt CAI could be a success but 
that its success has yet to be demonstrated. In addition, they indicated that 
student interest cuid motivation could be higher than in traditionally instructed 
classes . 

The teachers generally believed that there were changes needed with the 
SAVI consoles centering on the lightpen or screen. The lightpen did not work 
consistently and there %«as some indication that glare on the SAVI screen was 
a problem. 

The teachers all reported that the curriculum, although it made excellent 
use of graphics (two teachers said this) , did not sufficiently stress the appli- 
cation of principles (one teacher), and was not adequately "debugged." This 
last comnent was the most reliable in that all the teachers reported this as did 
man y of the Reading students. It is suggested that a closer look be made of the 
curriculum emd the "bugs" which may still be present. 

All the teachers indicated that the concept of CAI could be used with 
children of all ability levels although one teacher reported that the brighter 
students would become bored with the repetition inherent in the Project GROW 
curriculum emd would need some enrichment materials. The reader will recall 
that many of the Reading students indicated that boredom was also a factor for 
them. 

Groups of the size presently employed can be handled but too many more pupils 
regardless of whether more SAVI consoles are supplied would put a prohibitive 
burden on the teachers' management of the system. Right now the duties of the 
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teacher in a CAI classroom are reasonable and manageable. 

The weekly topic summaries indicating pupil progress seemed adequate in 
terms of format but they did not arrive weekly nor were they accurate. We are 
aware of this problem and are making efforts in this area. Much of the difficulty 
with the topic summary reports can be traced to the movement of the computers 
from Willow Grove to 5th and Luzerne. In essence, the entire software package 
had to be changed. 

Biology Students ; 

As with the Reading students' data, the responses from the Biology students 
will be treated separately by school only when substantial variability over 
schools was observed. Otherwise, all schools will be grouped together. 

Question 1: "During each period you worked part of the time with the SAVI 

Unit and part of the time with the teachers. Do you think that there should 

be more time spent on the machines?" 

As with the Reading classes , there was a divergence of opinion with respect 
to this question. At Germantown and Roosevelt, 77% and 74% respectively 

answered "yes" to this question while at Overbrook the affirmative response 
was only 41%. 

Those students who answered affirmatively generally said that the machines 
were easier to work with than a teacher. Some indicated that "you could go at 
your own speed" and if somebody was absent, it didn't matter as the class was 
not held up. Nevertheless many pupils indicated that they needed more time on 
the machines because they (the machines) were not functioning properly and the 
material was not covered. Therefore they needed more time. 

Those students who were not in favor of more time at the consoles indicated 
that there were questions and explanations a teacher could give that the SAVI 
could not. We may again be observing a pro and anti-machine split as with the 
Reading students although it is not immediately clear why they should cluster 
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in one school . That is , the students at Overbrook High School generally gave 

more negative responses to questions dealing with the machines than did the pupils 
at the other schools. 

All the students reported that the machine was easy to use and that they 
enjoyed the part of the lesson at the SAVI. 

When asked why they enjoyed working with the SAVI the majority of the 
Biology pupils said it was because they could go at their own speed and that the 
machine "took nice small steps which I could understand." 

Question 5: "Sometimes students do not like working with the SAVI units. 

If you did not was it for any of the reasons given below? Select the 

one that applies most to you." 

I did not like working with the SAVI because 

a. The machine was too slow. 

b. Each step was so small that I never felt I was learning anything. 

c. I could not read a lot of the words. 

d. It was boring. 

e. Other. 

There were some school differences with respect to this (question. None of 
the students, except in isolated cases, chose a, b, or c. However 33% of the 
Germantown pupils indicated that working with the machine was boring, whereas 
in Roosevelt and Overbrook these percentages were 11% and 12% respectively. 

There is no clear explanation for these data. 

A number of students indicated that they had "Other" reasons for not liking 
to work with the SAVI. The percentages of students falling into this category 
were 21%, 40%, and 21% for Germantown, Roosevelt, and Overbrook respectively. 

Many of these students complained about the "bugs" in the material and the fact 
that many times the machines did not work. These same comments were made in 
the Reading classes. 

Summary 

Again we obtained data from the Biology students which reinforced the 
teacher data. The students basically liked the machines and considered them 
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easy to use especially because they could go at their own speed. However, the 
"down-time" and the errors in the curriculum were a source of frustration to the 
students and need to be be corrected. 

Interestingly enough, the possible breakdown of students into those in 
favor of more and more time with the consoles versus those who wanted more time 
with the teacher was obtained with the Biology as well as Reading students. In 
the future, we will need to identify these students to see if there is any 
relationship between their attitudes toward machines and their achievement. We 
believe that the negative responses, that is responses saying "less time on the 
machine" may be particularly significant. In some sense, the questionnaire was 
constructed to favor a positive response. In addition, the socially desirable 
response was a positive one. However, it is not clear why the "negative" 

Biology students should cluster in Overbrook High School. This school certainly 
did not have a monopoly on "down-time." 
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Biology Teachers : 



Responses were obtained from the 5 Biology teachers involved in Project 
Grow. As with other small groups, one needs to remember that percentages can 
be deceiving in that with a group of size 5, the only percentages possible are 
0, 20, 40, 60, 80, and 100%. 

Generally, the Biology teachers responded as did the Reading teachers. 

They considered that CAI could be a success but that its success has yet to be 
demonstrated. They did agree with the Reading teachers that interest and rnoti* 
vation might be an important advantage of CAI over traditional instruction. Two 
out of five Biology teachers were willing to say that CAI could be a great success. 
None of the Reading teachers made this statement. However, in view of the small 
group sizes, more weight must be given to those questions where all teachers agreed 
rather than where only one or two did. 

There was agreement that changes necked to be made in the SAVI units but 
there was no unanimity with respect to what these changes should be. In fact, 
changes were suggested for all areas of SAVI: the keyboard, lightpen, and the 

SAVI screen. One teacher provided the following comments: 

"The lightpen should have been designed with a twenty degree angle at the 
tip. The present necessity of holding the pen at a full ninety degree angle to 
the screen is difficult at best. Further, the pen should have been reinforced 
at its junctiire with the cord to prevent the frequent breaks. The screen should 
also have been cuigled and hooded. The light requirement of the offline activities 
make the present ninety degree screen angle prone to annoying reflection. The 
table and chairs used in conjunct^ion with the terminal should be subject to a 
careful study, as at present they are dissatisfactory." This was the only comment 
with respect to tables and chairs and unfortunately, there was no elaboration. 
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The Biology teachers as a group indicated that the CAI concept could be 
used with children of all ability levels but that the curriculum, although 
logically written, and generally of very high quality, was not sufficiently 
"debugged.” It may be of some interest to note that the Reading teachers 
also commented on the "bugs" in the curriculum but generally had less favor- 
able remarks about the curriculum. 

Favorable reaction was obtained to the pupil/teacher ratio. It was 
generally agreed that the ratio of 1 teacher to 16-20 pupils was manageable. 

A majority of the teachers reported that the duties involved in managing 
the system, working the machines, teletypes, and so on were reasonable and 
the system was manageable. 

As with the Reading teachers, 100% of the Biology teachers would like to 
receive a weekly siunmary report of each pupil's progress. This summary should 
be teacher oriented, providing averages of a student's performance. In this 
area, the student summary report may be more useful than the weekly summary 
report . 

Summary ; 

Generally speaking, the Biology and Reading teachers reported that the 
CAI concept has great potential, but that due to problems with the hardware 
(e.g. SAVI console) and software (curriculum programs) , this potential has yet 
to be realized. Basically, the physical set-up of the classrooms is adequate, 
the class-size and system management duties are reasonable. As one teacher 
put it; "The program has a potential unequalled by any other system or in- 
structional aides. Unfortunately, the program barely taps this reservoir." 
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Section Four 



Introduction t 

Following each instructional unit in the CAI curriculum, the students in 
the CAI classes took a unit test at the SAVI console. The students received 
immediate feedback on their performance to each question and to the test as 
a whole. The items that were used in the first two Multi-Unit Tests were a 
stratified random sample of these items. The stratification was done on unit 
length. It is clear that when the CAI students responded to the items on the 
Multi-topic tests, they were doing so for a second time and therefore may have 
had an advantage over the traditionally instructed students who had never seen 
the items before. Therefore any observed difference between the two instruc*- 
tional groups may be due completely or in part to the fact that they (the CAI 
pupils) had seen the items before and not to the method of instruction per se. 
Below an attempt will be made to estimate the effect of this initial testing. 
However this is only an estimate and an extremely crude one. One must be very 
cautious in interpreting the results of these analyses until further data can 
be collected. 

The multi-topic test cover approximately six units in Biology. They were 
constructed by taking a random selection of about 40 questions from a given 
group of six units in the Biology SAVI curriculum. The selection was made to 
keep the relative emphasis of the units proportional to length of each unit in 
the curriculum. That is, if unit A was twice as long as unit B, then in the 
multi-topic test, twice as many of the questions dealt with unit A as with unit 
B. 

As indicated, the questions used were the same ones as had been previously 
presented to the on-line classes. This was undoubtedly an advantage for the 
CAI students. The magnitude of this advantage is unknown. Several strategies 




%#ere considered auid for rnemy reasons, this multi^topic test strategy was chosen 
even though it does favor the on-line classes. Initially, it «ias decided to 
remove these questions frcmi the SAVI instruction. This was not acceptable 
since the tests are used fur instrijictional purposes. While responding to the 
questions, he student is informed immediately as to whether his answer was 
right or wrong and what the correct amswer was. In the opinion of the 
curriculum %iriters, removing these te:4ts would constitute a serious shortcoming 
in the logic of the instructional sequence. Secondly, it was decided to con- 
struct new tests which would be essentially parallel forms of the current on- 
line tests. This presented an investment in time and personnel which was 
prohibitive at the present time. It was also thought that this strategy would 
give an advantage to the on-line classes also and since the use of the multi- 
topic tests involved considerable savings in time and effort, it was decided 
to use them. Finally, all the questions %#ere four-choice multiple choice questions 
and were administered in booklet form with separate Digitek answer sheets. 

Data analysis of the first Two Multi-Unit Tests (MDT-1 and MUT-2) : 

In each of the three schools %diere data %#ere available on the first two 
Hulti-Unit Tests, an analysis of variance was performed with Method of Instruc- 
tion as one of the factors. Initially an item amalysis was done for both 
tests for the CAI students and the traditionally-instructed students in 
separate groiq>s. The data from the item analyses can be used to revise the 
instrument for later use. By examining the item structure, the difficulty, 
discrimination, and distractor effectiveness, revisions of faulty items can be 
acccxnplished in order to obtain better evaluation instruments. Before consid- 
ering the results of the analyses of vauriance, the basic psychometric charac” 
teristics of MUT-1 and MUT-2 for CAI and the non-CAI students will be reported. 
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Table 1 

Psychometric Characteristics of MUT-1 for 

CAI Students 



Nunflser of Items on Test 

NuBd>er of Students 

Test Mean 

Test 

Test Standard Deviaition 

The Mean Difficulty of the Items on This Test 

The Average Biserial Correlation 

Standard Error of the Biserial Correlation 

Estimated Interitem Correlation 

Kuder-Richardson 20 Estimate of Reliability 

Standaurd Error of Measurement 



40 

148 

28.82 

37.08 

6.09 

.720 

.489 

.082 

.240 

.833 

2.49 



Psychometric Characteristics of B5UT-1 for 
Non-CAI Students 



Number of Items on Test 

Number of Students 

Test Mean 

Test Vauriance 

Test Standard Deviation .... 

The Mean Difficulty of the Items on This Test- 

The Average Biseriaa Correlation 

Standard Error of the Biserial Correlation 

Estimated Interitem Correlation 

Kuder-Richardson 20 Estimate of Reliability 

Standard Error of Measurement— 



40 

247 

22.51 

41.49 

6.44 

.563 

.452 

.064 

.204 

.819 

2.74 



O 

ERIC- 
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Table 2 



Psychometric Characteristics of MUT-2 for 

CAI Students 



Number of Itesis On Test 39 

Nunber of Students 123 

Test Mean 23.01 

Test Vauriance 53 . 37 

Test Standard Deviation 7.31 

The Mean Difficulty of the Items on This Test 0.590 

The Average Biserial Correlation 0.550 

Standard Error of the Biserial Correlation 0.091 

Estimated Inter item Correlation 0.302 

Kuder-Richardson 20 Estimate of Reliability — — 0.873 

Standard Error of Measurement 2.60 



PsychoBietric Characteristics of MUT-2 for 
Non-CAI Students 



Number of Items On Test 39 

Nuiber of Students 194 

Test Mean 17.60 

Test Veuriance 37.59 

Test Standard Deviation 6.13 

The Mean Difficulty of the Items on This Test 0.451 

The Average Biserial Correlation — 0.437 

Standard Error of the Biserial Correlation 0.072 

Estimated Interitem Correlation 0.191 

Kuder-Richardson 20 Estimate of Reliability 0.797 

Standard Error of Measurement 2.76 



On the first Multi -Unit Test, there %«ere virtually no differences in the 
data from the tvio groups for test characteristics such as the average 
biserial correlation and interitem correlation. There were sooie differences 
for the second test centering in the area of reliability estimation. 

A preliminary examination of the remainder of the item analysis data 
indicated that there were slight ambiguities in some of the item stems. These 
will be remedied before further use is made of this instrument. Other appro- 
priate methods will be used to improve any item distractors as the data warrauit. 

Results of Analyses of Variance of MUT-1 Scores ; 

Because there were differences among the schools in terms of the manner 
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in which the CAI system was in^lemented, the most meaningful picture of these 
data can be seen if the results from the schools are dealt with separately. 

Roosevelt Junior High School ; 

At Roosevelt, seven classes are involved in the CAI project. Three of 
these classes receive CAI instruction in Biology while the remaining four are 
instructed in Biology in a traditional classroom. There are different teachers 
in each instructional method, that is "Teachers" as a factor is nested within 
the factor of "Instructional Method." in addition, one of the CAI classes is 
of lower ability than all the other classes, both CAI and traditional. A one- 
%iay analysis of variance was carried out to investigate the presence of mean 
differences in achievement among the classes. A significant P ratio (P = 8.5330 
df: 6 , 105m(<.01) indicated the presence of at least one mean difference. A 
post-hoc 2 uialysis using Scheffe contrasts was done to isolate the differences 
present. The results of the Scheff^ analysis indicated that while there was no 
difference in the mean achievement of the two academic tracks represented at 
Roosevelt Junxor Hxgh School, the students in the CAI classes scored significantly 
higher than those in the non-CAI classes. The means and standard deviations of the 
seven groups involved and the results of the analysis of variance are shown in 
Table 3 and Table 4. 

Table 3 

Means and Standard Deviations for the Seven Treatment Groijps 
at Roosevelt Junior High School 

CAI]_ CAl 2 CAI 3 Tradi Trad 2 Trad 3 

Mean 34.5625 31.9333 28.7857 26.94444 27.7143 27.5789 

Standard Deviation 2.8976 4.7879 4.0417 3.5723 6.1071 4.5743 



Trad4 

22.8125 

8.3044 



Table 4 



Analysis of Variance of MUT - 1 Results at 
Roosevelt Junior High School 



Sum of Squares DF 



Mean Squares 



F 



Between Groups 



1351.6699 



6 



225.2783 



8.5330 



Within Groups 



2772.0942 



105 



26.4009 



Total 



4123.7617 



111 




Germantown High School ; 

At Germantown High School the data were 2 uialyzed in a 2x2 factorial 
design. The factors of "Instructional Method" (CAI and Traditional) and 
"Academic Track" %«ere completely crossed. There were also two teachers 
involved in the CAI study in this school. Each teacher taught one class 
in each of the four cells except the traditionally instructed slow class. 
Therefore, a third factor of "Teacher" could not be included in the design. 

The results of the analysis of the Germantown High School data indicated 
that there -.s a significant difference in me 2 ui achiev^nent between the 
academic tracks with the slower students' mean performance significauitly 
lower. There was also a signific 2 uitly higher me 2 ui score in the CAI classes 
than in the traditional classes. The respective F - ratios of 19.73 amd 26.86 
with df 1,72 were both significant at the .01 level. The interaction F - 
ratio was less thaui 1.0. The marginal meauis and the cell means and the 
results of the analysis of variauice are shown in Table 5 and Table 6. 
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Table 5 



Cell Means and Maurginal Means of the MUT-1 Scores at 

Germantown High School 



Cell Identification 



Cell Means 



Regular track; CAI instruction 
Regular track; traditional instruction 
Slow track; CAI instruction 
Slow track; traditional instruction 



29.789 

22.526 

23.526 

16.789 



Factor 


Level 


Means 


Academic Track 


Regular 


26.158 




Slow 


20.158 


Instructional Method 


CAI 


26.658 




Traditional 


19.658 



Table 6 

Analysis of Variance of MUT-1 Results for 
Germantown High School 



Source 



DP 



Between Academic Tracks 
Between Instructional Methods 
A.T. X I.M. 

Within Cells 



'*.99,1,72 



6.95 



1 

1 

1 

72 



Mean Squares F 

684.000 19.73 

931.000 26.86 

1.311 <1 

34.664 



Overbrook High School ; 

At Overbrook High School it was possible to analyze the data in a 2x2x2 
completely randomized design. The three factors which were crossed were 
"Academic Track," "Instructional Method," and "Teacher." The only main effect 
which was significant was that due to "Instructional Method." The students in- 
structed in the CAI classes had a significantly higher mean performance than 
the students in the traditional classes. (P = 19.231, df: l,80,p <.01) . None 
of the other main effects or interactions were significant at the required alpha 
level. The cell means, the marginal means, and the results of the analysis of 

variance are shown in Table 7 and Table 8. 
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Table 7 



Cell Means and Marginal Means of the MUT-1 Scores at 

Overbrook High School 



Cell Identification 



Cell Mean 



Academic Track, CAI, Teacher A 
Academic Track, CAI, Teacher B 
Academic Track, Traditional, Teacher A 
Academic Track, Traditional, Teacher B 
Regular Track, CAI, Teacher A 
Regular Track, CAI, Teacher B 
Regular Track, Traditional, Teacher A 
Regular Track, Traditional, Teacher B 



28.545 

29.727 
22.091 
27.455 
28.182 

25.727 
19.182 

22.545 



taczor Level Mean 

Academic Track Academic 26.955 

Regular 23.909 

Instructional Method CAI 28.045 

Traditional 22.818 

A 24.500 

B 26.364 



Table 8 



Analysis of Varieuice of MUT-1 Results for 
Overbrook High School 



Source 



Df 



Mean Square 



F 



Between Academic Tracks i 
Between Instructional Methods 1 
Between Teachers 1 
A.T. X I.M. 

A.T. X T. I 
I.M. XT. 1 
A.T. X I.M. XT. 1 
Within Cells 80 
Total 97 



204.045 


6.528 


601.136 


19.231 


76.409 


2.444 


16.409 


<1 


43.682 


1.397 


137.500 


4.399 


3.679 

31.259 


<1 



F 



99,1,80 



6.90 



Summary of Analysis of Variance ; 

The data from the three schools clearly indicate that the students in 
the classes have significantly higher performance than those in the traditionally 
instructed classes. As one can see from observing the means of the various groups. 
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this effect has practical as well as statistical significance. The fact that 
in only one school was there a significant difference in test performance of 
the academic tracks may be a within-school variable with respect to just this 
one institution. The students in the other schools may be more alike academically 
but divided into various tracks as part of the school's procedural policy, while 
in Germantown High School where the difference in academic tracks was found, 
there may be real differences in the ability of the students in the various tracks 
rather than a relative difference as may be the case in the other schools, in 
any event, as further data is collected it will be possible to look in greater 
detail at the effect of different academic tracks upon performance in the Project 
GROW schools. The absence of any interactions greatly aids in the clear inter- 
pretation of the main effects. 

The effect of previous item exposure on the performance of the CAI pupils 
on MUT-1 ; ■ ^ 

As indicated above, the CAI students had had previous exposure to the 
items that were used in the multi-unit tests. It was anticiapated that a sample 
of the CAI pupils could be taken to estimate the effect of this previous exposure. 
However, due to technical problems involving the CAI system and programs, these 
data could not be obtained. Out of the eight units whose content was included 
in the first multi— unit test, data was available for only a very small group 
of students on two different groupings of three units. Each of these *^^11 
samples represents less that 10% of the pupils in the CAI classes. One group 
of eight pupils had data available on the 5th, 7th, and 8th Biology units. 

(The first eight units were included in MUT-1) . The average percent correct 
for the first testing was 62%. When the same pupils were tested on the same 
units with MUT-1, the average percent correct was 69%. A second group of nine 
students had data for the 5th, 6th, and 8th Biology units. At the first testing, 
the average percent correct on these units was 74%. For the second testing, it 
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was 71%. What conclusions one could draw from these data is questionable. One 
is tempted to say that if there was a substantial effect of the first testing, 
then these data would not be equivocal as they are. However, this is not known 
and therefore the reader is cautioned to be extremely careful in making general- 
izations from these data. 

Results of the Analyses of Variance of MUT-2 Scores ; 

Roosevelt Junior High 

The general analysis method used was a one-way fixed effects ANOVA with 
3 CAI and 4 Traditional classes. All of the traditional classes were in the 
Academic track as were two of the CAI classes. The remaining CAI class was in 

the General track. Table 9 shows the results of the ANOVA and the Scheffe post- 
hoc comparisons. 



Table 9 



Results of MUT-2 Testing At 
Roosevelt Junior High School 



Source 



DF 



SS 



MS 



F 



Between Groups 6 



1564.66 



260.78 



8.87 



Error 



101 



2970.00 



29.41 




Post-Hoc Scheff^ Analysis 



Comparison 



CAI vs Traditional p < . 01 
Academic vs General p>.01 



Cell Means and Standard Deviation 



CAI^ CAI2 CAI3 Tradi Trad2 Trad3 Trad4 

28.71 30.73 24.70 20.96 23.62 23.92 19.79 

5.18 3.43 6.17 4.03 7.07 6.20 6.24 



Mean 

Standard Deviation 



As can be seen from Table 9, the overall F-ratio was highly significant. 

Two post-hoc comparisons were made. The initial one was for the CAI vs. the 
Traditional classes. This comparison was significantly different from zero at 
the .01 level. The difference needed for significance was 4.866; the difference 
actually obtained was 5.976. In view of the error mean square for this analysis, 
this difference has practical as well as statistical significance. 

A second comparison between the Academic and General classes was made. 

The mean of the General students was 24.7000; for the Academic classes it was 
24.6265. This difference was non-significant as can be seen by inspection. 

Germantown High School 

At Germantown High School, the MUT-2 results agreed with those from 
MUT-1. The main effects for Academic Track and for Method of Instruction 
were highly significant. The direction or significance favored the regular 
students and the CAI students respectively. There was no interaction. 



Table 10 

Results of MUT-2 Testing At 
Germantown High School 



Source 


DF 


MS 


F 


Academic Level 


1 


429.02 


17.22 


Method of Instruction 


1 


540.25 


21.68 


A.L. X M.I. 


1 


1.23 


<1 


Error 


36 


896.90 





^.99,1,30 

Cell Means and Marginal Means 



Cell Identification 


Mean 


Regular, CAI 


25.50 


Regular, Traditional 


17.80 


Slow, CAI 


18.60 


Slow, Traditional 


11.60 



Academic Level 


Regular 


21.65 




Slow 


15.10 


Instruction*: 1 Method 


CAI 


22.05 




Traditional 


14.70 



ERIC 
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Overbrook High School: 



For the second multi-unit test, data were available for only five classes. 

One was a traditionally instructed class and the other four were CAI classes. The 
F-ratio obtained from the analysis of variance was 5,68 which was significant 
at the .01 level. A post-hoc analysis using the Scheffe technique showed that 
there was a significant difference in the average performance of the CAI and 
traditionally instructed pupils. The CAI pupils performed significantly better. 
Table 11 shows the results of the analysis of variance and the cell means and 
standard deviations. 

Table 11 

Results of MUT-2 Testing At 
Over brook High School 

DF MS F 

4 200.37 5.68 

42 35.29 

Cell Means and Standard Deviations 



CAIi 


CAI 2 


CAI 3 


CAI 4 


Tradi 


Mean 21.50 


18.30 


24.27 


18.40 


13.65 


Standard Deviation 6 . 76 


5.19 


6.54 


8.65 


4.85 



Source 



Between groups 



Error 



^ 99 , 4,42 = 3-82 
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Summary: 



The data from the second Multi-Unit test pointed again to the significantly 
superior performance of the pupils in the CAT classes. As a point of interest, 
it might be beneficial to remind the reader that when we obtain a significant 
F-ratio from an analysis of variance, we conclude that the means in the popula- 
tions from which our data were obtained are not all equal. We then often use 
some sort of post-hoc analysis to help isolate the differences. That is, the 
overall F-ratio tells us that there is a difference, it does not tell us where . 
The second point is that the statistics do not tell us the cause of the differ- 
ence. 

The analyses of the MUT-2 test scores clearly indicate a significant differ- 
ence in means. The reason for this difference may be due to the method of 
instruction. It may also be due to the fact that the CAT students had an 
advantage over the traditionally instructed pupils because they saw the items 
before. Also some combination of these two effects may be the reason fcr the 
observed differences. The fact is that we do not know which of these is the 
case; or if any of them are. 

We urge the reader to be extremely cautious with these data. They may point 
to the effectiveness of CAI, or they may not. We do not have sufficient data to 

correctly interpret these scores. Next year, when the system and program are 

\ 

less experimental, we will have more information on which to base a conclusion. 
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An overall sunnary of the research of this past year cannot legltlaately 
be aade independent of events which to<dc place during the i^lcMntation of 
this uotfc. As noted in the preface of this report, the project HROV hardware 
and personnel were relocated during the early part of FAruary, 1969. This 
event had great repercussions. Cowputers can ha exceedingly versatile. They 
can also be exceedingly delicate. In reality, the systew did not operate 
optlaally after the relocation. In addition, coincident with the wovesKnt of 
the systew to the 5th and Luseme Streets was a diange in the Central Processor. 
The result was that wuch of the software packages had to be Modified. This 
presented a further sethacx. There were a nuaber of problcMs particular to 
eadi school diich added to the difficulty. Both Genantown Hig|i School and 
Ovexbrook Hidi Sdiool experienced periodic wal functioning of the air-condition- 
This was particularly severe at the fonwr sdiool. The progran 
at VanaBaker Junior Hig|i School had difficulty getting started vf i always 
■any nonths bdiind the other sdiools. In addition, all sdiools were affected 
by ''down-tlae.'* 



The conclusion one wist arrive at is that, in reality. Project GBOtf has 
just begnni To say that students at the GROW schools received cosgiuter assisted 
instruction during the past year would not be conpletely accurate. Rather, they 
received a coabination of CAI and traditional instruction. This wakes it very 
difficult to draw conclusions frow the research we have r^iorted. The results 
of the wilti-unit tests look very favorable. However, data collected std>- 
seipient to their administration would suggest that the ixdierent advantage to 
the CAI students was greater than suspected. We recoanend that next year these 
tests not be used as part of any research. 

The results of the standardised tests were equivocal. In Reading, we 
generally obtained the kinds of effects anticipated. That is, the students in 

5-1 





the CAI desses perfcraed slgnlflcently better then coaperd>le students In 
tredltlonel desses. 

The results of the Biology Test were less fevoreble. Differences In 
edilevesient were not obtelned In eny of the schools uhere the tests were ed- 
■Inlstered. As ue Indlceted In Section TWo, there ere severel explenetlons 
for this. For one. The Mslson Biology Test may not be of sufficient content 
velldlty. Although It eppeered to be the aost relevent of ell stenderdlsed 
Biology tests for the pupils In question. It still ney not be good enough* The 
problens with the systea aske It difficult to drew aeenlngful conclusions. 

The dete gethered through ^he questlonnelres aey be the aost relevent. 
These dete consistently Indlceted thet the pupils end teechers could eppreclete 
the treaendous benefits of coaputer esslsted Instruction, but the "hugs'* end 
"down-tine" were very frustretlng. 

We heve done neny enelyses this pest yeer end we find thet my conclusions 
drewn nust be eztreaely tentetlve. We offer these results es e suanery of 
efforts In en enper tsant el progrea Involving congniter esslsted Instruction. 

In the coning yeer we hope to errlve et nore of en understendlng of the Inter- 
ectlon between the currlculua, the student, end the coaputer. We hope to find 
out whether e student's ettltude toward coiqmters end his personality In 
general heve any relationship to his ech levoacnt . We hope to do studies using 
dete generated by the Central Processor. One group of these studies will In- 
volve en analysis of the effectiveness of the currlculua' s reoadletlon. We 
believe thet the aerlts of CAI can only be es greet es the currlculua used. 

We TiicoHiend thet efforts be pieced toward developing nore basic understendlng 
of the learning process es It Is exhibited by students et the SAVI consoles. 

We believe thet this type of work needs to be done before we can answer the 
overall question of idiether CAI Is nore effective then tredltlonel Instruction. 

We therefore urge thet this report be accepted es e starting point toward 
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future Inrestlgetlon. Ai our z/*tem becoaee operetlonel, we believe thet the 
effectiveness of co^iuter assisted Instruction will be odilblted end thet the 
prellBlnery efforts we have aede In this area will be rewarded. 



APPENDIX 1 



Contentg ; 

1) A List of CAI Biology Topics 

2) A List of Oil Reading Topics 

3) Student Questionnaire 

4) Teacher Questlcmnaire 






Biology Curriculum 
Topics 



Introdution to Skills Needed 
Introduction to Biology 
History of Biology 
Superstitions and Science 
Characteristics of Life 
Cells 

Energy and Life 

Elements and Compounds 

Chemical Symbols 

Equations and Reactions^ 

Chemistry and Life 

Classification 

Bacteria 

Viruses 

Algae 

Fungi 

Nosses 

Vascular Plants I 
Vascular Pl2uits II 
Seeds and Flowers 
Fertilization and Growth 
Protozoa 

Porifera and Colenterates 
3 Worm Phyla 

Mollusca and Ecliinodermata 
Arthropoda I 
Arthropoda II (Insects) 

Fish 

Amphibia 

Reptilia 

Aves 

Hammalia 

Introduction to Genetics 

Mitosis and DMA 

Reproduction 

Inheritance of Traits 

Twins 

Mutations 

Environment and Heredity 

Genetics in Action 

Facts and Fiction 

Digestion 

Circulation 

Respiration 

Excretion 



Sensitivity 
Body Regulators 
Reproduction 

Anthropology (Biology of Man) 

Evolution 

Ecology 
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Reading Topics 
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Introduction (rev.) 

Directed Reading Activity (Martin Luther King) 
Sentence Recognition (revised) 

Sumnary Statement of Sentence Idea 
Ii 2 d)eling 

Relationship between Sentences 
Ordering Sentences 
Finding the General Topic 
Finding the Specific Topic 
Finding the Supporting Details 
Finding the Topic Sentence 
Relationships in Paragraphs 
Following Directions (Small Details) 

Following Directions (Order in Directions) 

Fact and Opinion 
Drawing Conclusions 
Inferences 
Cause & Effect 
Context 

Crossword Puzzles 
Games 
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THE SCHOOL DISTRICT OF PHILADELPHIA 
Division of Instructional Research 



School 

I attended the Computer class in reading 

(circle one) 



biology 



Directions; Your answers to these questions will help your teacher 
and the other people working with the computer classes. Some of tne 
questions can be answered by circling one choice from a Ust. in 
Others, you will have to write in your answers. Thank you for your 

cooperation. 



1. During each period, you worked part of the time with the SAVI 
unit and part of the time with the teachers. Do you think 
that there should be more time spent on the machines? 



a. Yes 

b. No 

c. No opinion 

a) If you said yes, why? 

b) If you said no, why? 

2. Was the machine easy to use? Yes No 

a) If you said yes, can you think of ways for making it even easier? 

b) If you said no, why did you say no? 



3. DO you like the part of the lesson that was on th,^ SAVI unit? 

a. Yes 

b. No 

c. No opinion 
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4. Students give many reasons for liking to work with the SAVI 
unit. From those listed below select the one that applies 
most to you. 



I 



liked to work with the SAVI unit because: 

a. I could go at my own speed. 

b. the machine never got tired of giving the question. 

c. it took nice small steps which I could understand. 

d. I liked the cartoons and pictures that were used. 

e. I could read all the words. 

f. Other: 



5. Sometimes students do not like working with the SAVI units. 

If you did not was it for any of the reasons given below? 

Select the one that applies most to you. 

I did not like working with the SAVI unit because 

a. the machine was too slow. 

b. each step was so small that I never felt I was lec rning 
anything. 

c. I could not read a lot of the words. 

d. it was boring. 

e. Other: 



6. Please add anything else which you feel would provide information 
to your teachers and the other people working with the computer 
classes. 
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THE SCHOOL DISTRICT OF PHILADELPHIA 
Division of Instructional Research 



School_ 

Subject taught 



Directions: The following inventory is designed to help evaluate 

the CAI program in Philadelphia. The purpose of these questions 
is to obtain information which will help in making future decisions. 
You will note that some of the questions are of a multiple choice 
variety. For these you can circle your answers. Other questions 
are more open-ended where room has been left for your written 
responses. If there is not enough room for your answers to these 
questions, you can continue on the back of these pages. Finally, 
if there were any points which you want to add, you may do this 
on the blank side of these pages or on separate sheets. Please 
fill in the information on top of this oage. Thank you for your 

cooperation. 



1) Jty overall feeling concerning CAI is that it can be: (circle 

one or more than one) 

a. a great success. 

b. a success but this success has yet to be demonstrated. 

c. better than traditional instruction as far as student 
interest and motivation is concerned. 

d. about as effective as traditional instruction. 

e. less effective than traditional instruction. 

f. other: - — 



2) Do you believe that any changes are needed with respect to 
the SAVI units ? 

ves No No opinion 



3) If you answered yes to number 2, do you believe that these 
changes should be made in the (check one or more than one) 

a. keyboard 

b. lightpen 

c. SAVI screen 

d. other 
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4) If you do think some changes would be beneficial in the SAVI 
units, what changes would you like to see? (Correlate your 
answer to this question with that in number 3.) 



5) With respect to the CAI curriculum in my area, I feel that 
(circle one or more than one) 

a. it stressed retention of unimportant details, 
b it did not stress application of principles sufficiently, 
c*. did not make sufficient use of graphics as a visual medium 

d. irifed^vocabulary which was too difficult for the stud^ts. 
(This would be other than technical vocabulary in Biology) 

e it was not sufficiently "de-bugged. " ^ 

f*. it was logically written and helped the student to grasp its 

ideas. 

g. it made excellent use of graphics. 

h. generally speaking it was of very high quality. 

i. other: 



6 ) 



What is the relationship between a student’s ability and CAI? 



a. 

b. 

c. 

d. 



e. 



The CAI concept can be used with children of all ability 

levels. . . , 

CAI works best with lower ability children. 

CAI works best with higher ability children. 

I do not really believe that it makes too much difference 
what type of instruction is used. The bright students 
learn and the less bright do not. 

other: 



7) 



The number of students in the CAI classes was 



8 ) 



a. too large ^ 

b. small in the sense that more students 

could have been handled 

c. just about right 

DO you agree that the number of students in a CAI class is 
limited only by the number of SAVI units. 



a. Yes 

b. No because 
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9) Were the duties of the teacher in the CAI classes reasonable? 
This feans other than teaching duties • Were there too many 
tasks involving turning equipment on or off# working the tele- 
type# 2 uid so on? Is the system manageable? 

Yes Ho They were manageable 

10) Would you like a weekly summary report of each pupil's progress? 
This is in addition to the ASR reports. 

Yes 

NO 

11) Is the weekly topic summary as it is now printed adequate for 
your needs? If not# what other information would you like? 

Or what would you like deleted? 



12) Please add anything else which you as an educator believe would 
be helpful in describing the Philadelphia CAI program. 
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